This document is licensed under a Creative Commons Attribution 4.0 International License.
All contained code is licensed under the Apache License 2.0.
The data used is licensed under a Open Data Commons Attribution License.
See the paper’s “Author Contributions” section for details on the contributors of data files.
Required libraries and runtime environment description.
## - Session info ----------------------------------------------------------
## setting value
## version R version 3.5.1 (2018-07-02)
## os Windows 10 x64
## system x86_64, mingw32
## ui RTerm
## language (EN)
## collate Spanish_Spain.1252
## ctype Spanish_Spain.1252
## tz Europe/Paris
## date 2019-04-30
##
## - Packages --------------------------------------------------------------
## ! package * version date lib source
## assertthat 0.2.0 2017-04-11 [1] CRAN (R 3.5.1)
## backports 1.1.2 2017-12-13 [1] CRAN (R 3.5.0)
## base * 3.5.1 2018-07-02 [?] local
## bindr 0.1.1 2018-03-13 [1] CRAN (R 3.5.1)
## bindrcpp 0.2.2 2018-03-29 [1] CRAN (R 3.5.1)
## broom 0.5.0 2018-07-17 [1] CRAN (R 3.5.1)
## callr 2.0.4 2018-05-15 [1] CRAN (R 3.5.1)
## cellranger 1.1.0 2016-07-27 [1] CRAN (R 3.5.1)
## cli 1.0.0 2017-11-05 [1] CRAN (R 3.5.1)
## colorspace 1.3-2 2016-12-14 [1] CRAN (R 3.5.1)
## P compiler 3.5.1 2018-07-02 [2] local
## cowplot * 0.9.4 2019-01-08 [1] CRAN (R 3.5.3)
## crayon 1.3.4 2017-09-16 [1] CRAN (R 3.5.1)
## P datasets * 3.5.1 2018-07-02 [2] local
## desc 1.2.0 2018-05-01 [1] CRAN (R 3.5.1)
## devtools 2.0.1 2018-10-26 [1] CRAN (R 3.5.1)
## digest 0.6.15 2018-01-28 [1] CRAN (R 3.5.1)
## dplyr * 0.7.6 2018-06-29 [1] CRAN (R 3.5.1)
## emidata * 0.1.0 2019-04-15 [1] local
## evaluate 0.11 2018-07-17 [1] CRAN (R 3.5.1)
## forcats * 0.3.0 2018-02-19 [1] CRAN (R 3.5.1)
## fs 1.2.6 2018-08-23 [1] CRAN (R 3.5.1)
## ggplot2 * 3.1.0 2018-10-25 [1] CRAN (R 3.5.2)
## glue 1.3.0 2018-07-17 [1] CRAN (R 3.5.1)
## P graphics * 3.5.1 2018-07-02 [2] local
## P grDevices * 3.5.1 2018-07-02 [2] local
## P grid 3.5.1 2018-07-02 [2] local
## gridExtra * 2.3 2017-09-09 [1] CRAN (R 3.5.1)
## gtable 0.2.0 2016-02-26 [1] CRAN (R 3.5.1)
## haven 1.1.2 2018-06-27 [1] CRAN (R 3.5.1)
## here * 0.1 2017-05-28 [1] CRAN (R 3.5.1)
## hms 0.4.2 2018-03-10 [1] CRAN (R 3.5.1)
## htmltools 0.3.6 2017-04-28 [1] CRAN (R 3.5.1)
## httr 1.3.1 2017-08-20 [1] CRAN (R 3.5.1)
## janeaustenr 0.1.5 2017-06-10 [1] CRAN (R 3.5.1)
## jsonlite 1.5 2017-06-01 [1] CRAN (R 3.5.1)
## kableExtra * 0.9.0 2018-05-21 [1] CRAN (R 3.5.1)
## knitr 1.20 2018-02-20 [1] CRAN (R 3.5.1)
## lattice 0.20-35 2017-03-25 [2] CRAN (R 3.5.1)
## lazyeval 0.2.1 2017-10-29 [1] CRAN (R 3.5.1)
## lubridate 1.7.4 2018-04-11 [1] CRAN (R 3.5.1)
## magrittr 1.5 2014-11-22 [1] CRAN (R 3.5.1)
## Matrix 1.2-14 2018-04-13 [2] CRAN (R 3.5.1)
## memoise 1.1.0 2017-04-21 [1] CRAN (R 3.5.1)
## P methods * 3.5.1 2018-07-02 [2] local
## modelr 0.1.2 2018-05-11 [1] CRAN (R 3.5.1)
## munsell 0.5.0 2018-06-12 [1] CRAN (R 3.5.1)
## nlme 3.1-137 2018-04-07 [2] CRAN (R 3.5.1)
## pillar 1.3.0 2018-07-14 [1] CRAN (R 3.5.1)
## pkgbuild 1.0.2 2018-10-16 [1] CRAN (R 3.5.1)
## pkgconfig 2.0.1 2017-03-21 [1] CRAN (R 3.5.1)
## pkgload 1.0.2 2018-10-29 [1] CRAN (R 3.5.1)
## plyr 1.8.4 2016-06-08 [1] CRAN (R 3.5.1)
## prettyunits 1.0.2 2015-07-13 [1] CRAN (R 3.5.1)
## processx 3.1.0 2018-05-15 [1] CRAN (R 3.5.1)
## purrr * 0.2.5 2018-05-29 [1] CRAN (R 3.5.1)
## R6 2.2.2 2017-06-17 [1] CRAN (R 3.5.1)
## RColorBrewer * 1.1-2 2014-12-07 [1] CRAN (R 3.5.0)
## Rcpp 1.0.0 2018-11-07 [1] CRAN (R 3.5.2)
## readr * 1.1.1 2017-05-16 [1] CRAN (R 3.5.1)
## readxl 1.1.0 2018-04-20 [1] CRAN (R 3.5.1)
## remotes 2.0.2 2018-10-30 [1] CRAN (R 3.5.1)
## rlang 0.2.1 2018-05-30 [1] CRAN (R 3.5.1)
## rmarkdown 1.10 2018-06-11 [1] CRAN (R 3.5.1)
## rprojroot 1.3-2 2018-01-03 [1] CRAN (R 3.5.1)
## rstudioapi 0.7 2017-09-07 [1] CRAN (R 3.5.1)
## rvest 0.3.2 2016-06-17 [1] CRAN (R 3.5.1)
## scales * 1.0.0 2018-08-09 [1] CRAN (R 3.5.1)
## sessioninfo 1.1.1 2018-11-05 [1] CRAN (R 3.5.1)
## skimr * 1.0.3 2018-06-07 [1] CRAN (R 3.5.1)
## SnowballC 0.5.1 2014-08-09 [1] CRAN (R 3.5.0)
## P stats * 3.5.1 2018-07-02 [2] local
## stringi 1.1.7 2018-03-12 [1] CRAN (R 3.5.0)
## stringr * 1.3.1 2018-05-10 [1] CRAN (R 3.5.1)
## testthat 2.0.0 2017-12-13 [1] CRAN (R 3.5.1)
## tibble * 1.4.2 2018-01-22 [1] CRAN (R 3.5.1)
## tidyr * 0.8.1 2018-05-18 [1] CRAN (R 3.5.1)
## tidyselect 0.2.4 2018-02-26 [1] CRAN (R 3.5.1)
## tidytext * 0.2.0 2018-10-17 [1] CRAN (R 3.5.1)
## tidyverse * 1.2.1 2017-11-14 [1] CRAN (R 3.5.1)
## tokenizers 0.2.1 2018-03-29 [1] CRAN (R 3.5.1)
## P tools 3.5.1 2018-07-02 [2] local
## usethis 1.4.0 2018-08-14 [1] CRAN (R 3.5.1)
## P utils * 3.5.1 2018-07-02 [2] local
## viridisLite 0.3.0 2018-02-01 [1] CRAN (R 3.5.1)
## withr 2.1.2 2018-03-15 [1] CRAN (R 3.5.1)
## xml2 1.2.0 2018-01-24 [1] CRAN (R 3.5.1)
## yaml 2.1.19 2018-05-01 [1] CRAN (R 3.5.1)
##
## [1] C:/Users/Carlos Granell/Documents/R/win-library/3.5
## [2] C:/Program Files/R/R-3.5.1/library
##
## P -- Loaded and on-disk path mismatch.
This document is versioned in a public git repo: https://github.com/cgranell/emi-mhealth.
This R notebook contains the code to produce the final figures and tables of the paper.
Input datasets are the processed datasets within the emidata data package. The package code is available in a public git repo: https://github.com/cgranell/emidata. We analyse the follwing three datasets of the emidata package:
112 records and 20 columns.129 records and 26 columns.136 records and 9 columns.The final number of papers to analyse is 111.
There are 14 distinct mental disorders (out of 25). About 25.2% (N=28) are categorised according to Section II of DSM-5 manual. About 74.8% (N=83) are 23-Comorbid disorders, 24-Various disorders or 25-Suicidal behavior disorder/nonsuicidal self-injury.
About 71.2% (N=79) of papers reported some kind of assessment, whereas 28.8% (N=32) reported no assessment at all. Looking closer at the type of assessment: 16.2% (N=18) focus on the effect of intervention on clinical symptomology; 30.6% (N=34) report a mix of effect and usability / UX assessment; 24.3% (N=27) focus solely on usability / UX.
Temporal distribution of papers colored by assessment type. It is a proportional stacked area chart in which the sum of each year is always equal to hundred, and the value of each group (assessment type) is in percentages.
Stacked barchart: Distribution of papers per mental disorders, colored by assessment type.
## Warning: Unknown levels in `f`: NO
Proportional (stacked) barchart: Distribution of papers per mental disorders, colored by assessment type. Note that we draw two main colors in the legend: purple represents no assessment at all, the range of greens denotes distinct types of assessment. Total percentatge per mental disorder is given at the end of each bar (white circle)
Distribution of types of assessments per mental disorders
| Mental Disorder | Type of assessment | Percentage |
|---|---|---|
| Depressive disorders | EFFECT | 22.7% |
| EFFECT AND USABILITY/USER EXPERIENCE | 45.5% | |
| NO ASSESSMENT | 27.3% | |
| USABILITY/USER EXPERIENCE | 4.5% | |
| Anxiety disorders | EFFECT | 28.6% |
| EFFECT AND USABILITY/USER EXPERIENCE | 21.4% | |
| NO ASSESSMENT | 50% | |
| Various disorders | EFFECT | 7.7% |
| EFFECT AND USABILITY/USER EXPERIENCE | 23.1% | |
| NO ASSESSMENT | 30.8% | |
| USABILITY/USER EXPERIENCE | 38.5% | |
| Trauma and stressor-related disorders | EFFECT | 15.4% |
| EFFECT AND USABILITY/USER EXPERIENCE | 46.2% | |
| USABILITY/USER EXPERIENCE | 38.5% | |
| Substance-related and addictive disorders | EFFECT | 20% |
| EFFECT AND USABILITY/USER EXPERIENCE | 30% | |
| NO ASSESSMENT | 40% | |
| USABILITY/USER EXPERIENCE | 10% | |
| Schizophrenia spectrum and other psychotic disorders | EFFECT AND USABILITY/USER EXPERIENCE | 12.5% |
| NO ASSESSMENT | 37.5% | |
| USABILITY/USER EXPERIENCE | 50% | |
| Suicidal behavior disorder/ nonsuicidal self-injury | EFFECT | 14.3% |
| EFFECT AND USABILITY/USER EXPERIENCE | 28.6% | |
| NO ASSESSMENT | 28.6% | |
| USABILITY/USER EXPERIENCE | 28.6% | |
| Comorbid disorders | EFFECT | 16.7% |
| NO ASSESSMENT | 33.3% | |
| USABILITY/USER EXPERIENCE | 50% | |
| Bipolar and related disorders | EFFECT | 20% |
| EFFECT AND USABILITY/USER EXPERIENCE | 40% | |
| USABILITY/USER EXPERIENCE | 40% | |
| Neurodevelopmental disorders | EFFECT AND USABILITY/USER EXPERIENCE | 33.3% |
| NO ASSESSMENT | 33.3% | |
| USABILITY/USER EXPERIENCE | 33.3% | |
| Feeding and eating disorders | NO ASSESSMENT | 33.3% |
| USABILITY/USER EXPERIENCE | 66.7% | |
| Sleep-wake disorders | EFFECT | 33.3% |
| NO ASSESSMENT | 66.7% | |
| Obsessive-Compulsive and related disorders | EFFECT AND USABILITY/USER EXPERIENCE | 66.7% |
| USABILITY/USER EXPERIENCE | 33.3% | |
| Personality disorders | EFFECT AND USABILITY/USER EXPERIENCE | 100% |
Linechart: Distribution of papers (top6 mental disorders) per year.
Table (Example 1): Distribution of papers (apps) per mental disorder. How many apps are related to each mental disorder? Per each mental disorder, assessment (yes/no) and year, we show the paper id and appname.
| Mental Disorder | Assessment | Year | Paper id | App Name |
|---|---|---|---|---|
| 1-Neurodevelopmental disorders | NO | 2016 | 304 | My MFG |
| YES | 2015 | 125 | iCanLearn | |
| 2016 | 142 | LifePal | ||
| 10-Feeding and eating disorders | NO | 2017 | 265 | Jorvie |
| YES | 2015 | 092 | RR: Eating Disorder Management | |
| 2016 | 007 | Student Bodies–Eating Disorders (SB-ED) | ||
| 12-Sleep-wake disorders | NO | 094 | SleepIO | |
| 2017 | 103 | SleepIO | ||
| YES | 181 | Sleepcare | ||
| 16-Substance-related and addictive disorders | NO | 2016 | 014 | CET Application |
| 065 | Smoke Mind | |||
| 2017 | 021 | CET Application | ||
| 307 | A-CHESS | |||
| YES | 2015 | 013 | A-CHESS | |
| 217 | SmartQuit | |||
| 2016 | 038 | Smart-T | ||
| 2017 | 171 | Mind the Moment | ||
| 2018 | 039 | Smart-T | ||
| 127 | SEVA | |||
| 18-Personality disorders | 2017 | 106 | EMOTEO | |
| 2-Schizophrenia spectrum and other psychotic disorders | NO | 2015 | 305 | Actissist |
| 2016 | 273 | TechCare | ||
| 2017 | 260 | SlowMo | ||
| YES | 2013 | 089 | FOCUS | |
| 2014 | 120 | FOCUS | ||
| 2016 | 117 | PRIME | ||
| 2017 | 087 | Heal Your Mind | ||
| 090 | iCOPE | |||
| 23-Comorbid disorders | NO | 2015 | 086 | NA |
| 2016 | 097 | Stop-Cannabis | ||
| YES | 2014 | 290 | Enuresis Trainer | |
| 2017 | 297 | CASA-CHESS | ||
| 2018 | 232 | SMI-CM | ||
| 300 | Learn To Quit | |||
| 24-Various disorders | NO | 2014 | 281 | The Moment |
| 2017 | 140 | SPIRIT | ||
| 185 | MoodTrainer | |||
| 2018 | 220 | WorkingWell | ||
| YES | 2013 | 126 | myCompass | |
| 2014 | 282 | SmartCAT | ||
| 2016 | 029 | iBobbly | ||
| 2017 | 034 | Wellframe | ||
| 110 | ACT Daily APP | |||
| 119 | PeerTECH App | |||
| 131 | IntelliCare Suite | |||
| 177 | Headspace | |||
| 294 | TODAY! | |||
| 25-Suicidal behavior disorder/ nonsuicidal self-injury | NO | 2013 | 275 | NA |
| 2016 | 245 | Blue Ice | ||
| YES | 2017 | 012 | NA | |
| 026 | Virtual Hope Box (VHB) | |||
| 124 | iBobbly | |||
| 2018 | 022 | Blue Ice | ||
| 030 | Blue Ice | |||
| 3-Bipolar and related disorders | 2015 | 048 | PRISM | |
| 258 | SIMPLe | |||
| 2016 | 042 | MyT | ||
| 226 | SIMPLe | |||
| 2017 | 138 | SIMPLe | ||
| 4-Depressive disorders | NO | 2015 | 035 | Kokoro-App |
| 2016 | 203 | MyGamePlan | ||
| 303 | NA | |||
| 2017 | 077 | NA | ||
| 188 | Moodivate | |||
| 235 | Dcombat | |||
| YES | 2013 | 058 | Get Happy Program | |
| 2014 | 051 | NA | ||
| 2015 | 023 | NA | ||
| 152 | MedLink | |||
| 231 | SuperBetter | |||
| 266 | NA | |||
| 2016 | 071 | NA | ||
| 183 | Mobile Sensing and Support | |||
| 187 | MoodHacker | |||
| 2017 | 114 | Thought Challenger | ||
| 263 | Kokoro-App | |||
| 279 | PRIME-D | |||
| 2018 | 020 | TODAC TODAC | ||
| 063 | Kokoro-App | |||
| 082 | 7Cups | |||
| 115 | SPSRS | |||
| 5-Anxiety disorders | NO | 2013 | 091 | GET.ON PAPP |
| 123 | NA | |||
| 2014 | 057 | CBT Assistant | ||
| 105 | GET.ON PAPP | |||
| 2015 | 027 | NA | ||
| 2017 | 192 | AnxietyCoach | ||
| 2018 | 025 | Lantern | ||
| YES | 2013 | 308 | NA | |
| 2015 | 286 | PsychAssist | ||
| 2016 | 122 | Ångesthjälpen | ||
| 285 | NA | |||
| 2017 | 050 | Public Speech Trainer (PST) | ||
| 291 | Agoraphobia Free; Stress Free | |||
| 2018 | 163 | NA | ||
| 6-Obsessive-Compulsive and related disorders | 2014 | 056 | Mayo Clinic Anxiety Coach | |
| 2016 | 262 | Geo-Feedback App | ||
| 2017 | 044 | Live OCD Free | ||
| 7-Trauma and stressor-related disorders | 2014 | 062 | PE Coach | |
| 2015 | 061 | PE Coach | ||
| 069 | PE Coach | |||
| 121 | Life Armor; PE Coach; Positive Activity Jackpot; Eventful; Tactical Breather; Virtual Hope Box; Daily Yoga; Simply Yoga | |||
| 160 | PTSD Coach | |||
| 2016 | 118 | PTSD Coach | ||
| 301 | RELAX | |||
| 306 | NA | |||
| 2017 | 015 | PTSD Coach | ||
| 037 | Life Armor; PE Coach; Positive Activity Jackpot; Eventful; Tactical Breather; Virtual Hope Box; Daily Yoga; Simply Yoga | |||
| 049 | PE Coach | |||
| 088 | PTSD Coach | |||
| 302 | NA |
Table (Example 2): Compact distribution of papers (apps) per mental disorder, grouping the references per app. The mumber(s) in brackets next to the app name is the reference(s) in which the app is mentioned.
| Mental Disorder | References by app |
|---|---|
| Personality disorders | EMOTEO (106) |
| Obsessive-Compulsive and related disorders | Geo-Feedback App (262), Live OCD Free (044), Mayo Clinic Anxiety Coach (056) |
| Sleep-wake disorders | Sleepcare (181), SleepIO (094;103) |
| Feeding and eating disorders | Jorvie (265), RR: Eating Disorder Management (092), Student Bodies–Eating Disorders (SB-ED) (007) |
| Neurodevelopmental disorders | iCanLearn (125), LifePal (142), My MFG (304) |
| Bipolar and related disorders | MyT (042), PRISM (048), SIMPLe (258;226;138) |
| Comorbid disorders | CASA-CHESS (297), Enuresis Trainer (290), Learn To Quit (300), SMI-CM (232), Stop-Cannabis (097), NA (086) |
| Suicidal behavior disorder/ nonsuicidal self-injury | iBobbly (124), Virtual Hope Box (VHB) (026), NA (275;012), Blue Ice (245;022;030) |
| Schizophrenia spectrum and other psychotic disorders | Actissist (305), Heal Your Mind (087), iCOPE (090), PRIME (117), SlowMo (260), TechCare (273), FOCUS (089;120) |
| Substance-related and addictive disorders | Mind the Moment (171), SEVA (127), SmartQuit (217), Smoke Mind (065), A-CHESS (013;307), CET Application (014;021), Smart-T (038;039) |
| Trauma and stressor-related disorders | RELAX (301), Life Armor; PE Coach; Positive Activity Jackpot; Eventful; Tactical Breather; Virtual Hope Box; Daily Yoga; Simply Yoga (121;037), NA (306;302), PE Coach (062;061;069;049), PTSD Coach (160;118;015;088) |
| Various disorders | ACT Daily APP (110), Headspace (177), iBobbly (029), IntelliCare Suite (131), MoodTrainer (185), myCompass (126), PeerTECH App (119), SmartCAT (282), SPIRIT (140), The Moment (281), TODAY! (294), Wellframe (034), WorkingWell (220) |
| Anxiety disorders | Agoraphobia Free; Stress Free (291), Ångesthjälpen (122), AnxietyCoach (192), CBT Assistant (057), Lantern (025), PsychAssist (286), Public Speech Trainer (PST) (050), GET.ON PAPP (091;105), NA (123;308;027;285;163) |
| Depressive disorders | 7Cups (082), Dcombat (235), Get Happy Program (058), MedLink (152), Mobile Sensing and Support (183), MoodHacker (187), Moodivate (188), MyGamePlan (203), PRIME-D (279), SPSRS (115), SuperBetter (231), Thought Challenger (114), TODAC TODAC (020), Kokoro-App (035;263;063), NA (051;023;266;071;303;077) |
Circular barplot (Example 3): Each cell means one occurence of the app in a paper.
Bubble plot: Distribution of papers per mental disorder and technology variables (sensor capabilities and features). Technology-related characteristics are ranked in each dimension.
In the following, some exploratory charts are shown on the way to reach the bubble plot, which is the last chart. None of the following charts are in production stage, only drafted. Please, do not pay much attention to the color palette and aesthetics yet.
22.5% of papers use at least a sensing capability (N=25). The use of the acc and gyr is residual; gps and mic are more significant, but in a low proportion: gps = 9.91%, mic = 10.8%, cam = 7.21% . Note that some papers use both type of sensors, so the sum of percentages of gps, mic and cam exceeds the total percentage of papers that use at least a sensing capability.
100% of papers provide/offer/use at least a feature capability (N=111).
5.41% of papers implement/use at least advanced analytics (N=6).
This is the final bubble plot.